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Abstract — Building the comprehensive evaluation model 
for the implementation effect of the transmission and 
distribution tariff reforms is crucial to the improvement of 
the transmission and distribution pricing mechanism, the 
smooth progress of the power marketization reform, and 
the sustainable development of the industry in China. An 
index system for evaluating the implementation effect of 
transmission and distribution tariff reform was built in 
four dimensions, which are economic efficiency, safety 
and reliability, energy saving and environment 
protection, satisfaction, and this index system contains 12 
detailed indicators. For comprehensively evaluate the 
implementation effect of China's transmission and 
distribution tariff reform, a hybrid MCDM model which 
combines the Matter-Element Extension Model with the 
Best-Worst Method was proposed. The Best-Worst 
Method was used for criteria weight determination, and 
the Matter-Element Extension Model was employed to 
rank the comprehensive performance of implementation 
effect of the transmission and distribution tariff reforms in 
China. This paper can provide references for policy¬ 
makers to improve the transmission and distribution tariff 
reform policy. 

Keywords — transmission and distribution tariff reform, 
comprehensive evaluation model, the matter-element 
extension model, the best-worst method. 

I. INTRODUCTION 

In 2015, ‘the Opinions on Further Deepening the Reform 
of the Power System’ issued by the Central Committee of 
the Communist Party of China proposed the separate 
verification of power transmission and distribution price 
in the principle of permitted cost plus reasonable income, 
and the electric power transmission and distribution 
prices would be verified by the voltage class. Perfect the 
grid’s constraint and incentive mechanism, promote grid 
enterprises to improve management, reduce costs and 


enhance efficiency. At the end of June 2017, all the 
provincial grids undertook the power transmission and 
distribution price reform, indicating that China's first 
round of power transmission and distribution price pilot 
reform has been fully completed. Since the pilot reform of 
the Shenzhen electric power grid, the power transmission 
and distribution price reform has been enduring more than 
two years, the effects and problems of the reform have 
gradually emerged. Therefore, it is necessary to establish 
a scientific and reasonable evaluation index system based 
on the actual situation of China's power transmission and 
distribution price reform to comprehensively assess the 
current work on the transmission and distribution price 
reform. 

Regarding the study of policy effect evaluation model and 
method, Swedish scholar Even Vedung proposed three 
kinds of policy evaluation model, namely professional 
model, economic model and effect model, and established 
10 models for different evaluating criteria [1], Ref. [2] 
summarized several most commonly used policy effect 
assessment methods, which are Before-and-after 
comparison method, whether-or-not-a-policy comparison 
method, Practice-and -planning comparison method. Ref. 
[3] pointed out that the evaluation of regulatory effect 
offers a way to improve regulatory decision-making and 
practice, proposing the regulatory effect evaluation model 
that can be applied in low-income and middle-income 
countries. 

For China’s studies, they mainly focus on basic 
theoretical research such as assessment step, principle, 
standard, and evaluation index system, few empirical 
studies have been taken in the policy effect of power 
industry reform. Ref. [4] measures the market-oriented 
reform performance of the power industry from two 
aspects of total power generation and price level, and the 
result shows that the market-oriented reform has 
significantly reduced the price of electricity, but there is 
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little impact on the total power supply. Ref. [5] used the 
DEA method to measure the efficiency of power 
generation enterprises, transmission and distribution 
enterprises, generation and transmission and distribution 
integration enterprises, and it also comprehensively 
evaluated the formulation, implementation and 
performance of power industry supervision policies based 
on the fuzzy comprehensive evaluation method. Ref. [6] 
evaluated the performance of electricity market from 
power generation side, power supply side, user side, 
market transaction and development coordination. Based 
on SCP analysis paradigm, the research has been taken in 
China's current electricity market structure, behavior and 
performance. Ref. [7] used the stochastic frontier model 
to measure the production efficiency of the power grid 
before and after the reform of China's power industry, 
indicating that the grid reform in 2002 was quite 
effective, but the efficiency of power transmission was 
low. Ref. [8] comprehensively evaluated the price 
subsidy, efficiency cost and welfare effect when 
introducing the peak valley electricity price after the 
ladder price, based on Ramsey pricing theory and 
cognitive price response hypothesis. Ref. [9] evaluated 
the power saving effect after implementing the residential 
ladder price plan, based on the utility function. 

The research on the reform of power transmission and 
distribution price is mainly reflected on the effectiveness 
of the reform, its existing problems, and the experience of 
foreign power transmission and distribution price control. 
The effect study of this type of regulatory model is still 
blank. With the continuous advancement of power market 
reform, the central and local governments, enterprises, 
useis and other parties are generally concerned about the 
imple mentation effect of power transmission and 
distribution prices in the cost plus income regulatory 
mode. Therefore, it is necessary to constmct a scientific 
and reasonable comprehensive evaluation model to assess 
and analyze the implementation effect of China's power 
transmission and distribution price reform 

II. THE ESTABLISHMENT OF EVALUATION 
INDEX SYSTEM 

This paper comprehensively evaluates the effectiveness 
and performance of the power transmission and 
distribution price reform policy. The government's 
regulation on the power transmission and distribution 
price not only includes economic supervision, but also the 
external issues, such as safety, reliability and 
environment, which belongs to the social supervision. 
Based on the objective principle of the power 
transmission and distribution price reform described 
above and the evaluation dimension in the UK RIIO 


regulatory model (revenue = incentive + innovation + 
output) [10], this paper develops an evaluation index 
system with 4 dimension, including economic efficiency, 
safety and reliability, energy saving and environ mentally- 
friendly. The index systemis shown in Figure 1. 


new power transmission and distribution capacity per unit investment 



Fig. 1: Evaluation index system of the implementation 
effect of transmission and distribution tariff reform 

1.1 Economic efficiency index 

The regulation of transmission and distribution price 
includes total income supervision and price stmcture 
supervision, and the verification of total income is based 
on effective assets. The price stmcture is verified by the 
voltage class, based on the power transmission and 
distribution’s effective assets, expenses and electricity of 
each voltage class. It can not only meet the normal and 
reasonable investment needs of the power grid, ensure the 
stable sources of the income level of the power grid 
enterprises, but also strengthen the cost constraints, 
strictly monitor the power transmission and distribution 
costs, facilitate the enterprises to improve the 
management, reduce costs and enhance efficiency. It 
includes the new power transmission and distribution 
capacity per unit investment, effective asset formation 
rate, cost reduction rate. 

1.2 Safety and reliability index 

The power transmission and distribution price reform has 
changed the main business of grid enterprises. The grid 
enterprises have been seen as network hubs, the main 
revenue of the grid will not only make up the related 
power transmission and distribution costs, but also 
promote the reliability of power grid security, 
safeguarding the main business [12]. China measures the 
reliability on the supply side by a number of indexes like 
the power supply reliability rate, average time of user's 
power outage and average number of user's power outage. 

1.3 Energy saving and environmentally-friendly index 
The traditional spread profit model is an insufficient 
incentive for grid enterprises to absorb new energy. After 
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the power transmission and distribution price reform, the 
market-oriented trading mechanism of electricity is 
gradually improved, and the conventional thermal power 
generation plan is implemented in an orderly manner. The 
planning and dispatching of the generation can prioritize 
the new energy generation, thus decreasing the energy 
consumption and the emission of polluted gas. In 
addition, the grid enterprises have certain responsibilities 
in energy saving and emission reduction. The power 
transmission and distribution price reform makes the grid 
to set a goal to offer the high-efficiency power 
transmission and distribution services, reduce the 
emission of carbon dioxide by cutting down energy 
consumption, reduce the emission of sulfur hexafluoride 
by the recycling and purification treatment system It 
includes the new energy generating consumption rate, 
carbon dioxide emission reduction, sulfur hexafluoride 
emission reduction. 

l. 4 Satisfaction index 

The power transmission and distribution price reform is a 
systematic project involving different subjects. The power 
grid enterprises belong to the controlled object, and do 
not involve in satisfaction survey. Based on the impact of 
power transmission and distribution price reform, the 
satisfaction index layer includes three main subjects: 
power users, power sales enterprises, and power 
generation enterprises. The satisfaction index can be 
calculated by the corresponding satisfaction 
questionnaires of power users, power sales enterprises 
and power generation enterprises. The respondents score 
the satisfaction according to [0~10]. 

m. COMPREHENSIVE EVALUATION MODEL 
FOR THE IMPLEMENTATION EFFECT OF 

CHINA'S TRANSMISSION AND 
DISTRIBUTION TARIFF REFORM 

Most comprehensive evaluation methods can only 
calculate a comprehensive value for the evaluating object, 
and compare the comprehensive values of multiple 
objects to judge the pros and cons. This paper evaluates 
the effect and performance of the power transmission and 
distribution price reform policy, and it is insignificant to 
simply calculate the comprehensive value of the 
evaluating object. The matter-element extension 
evaluation method can divide the evaluating object into 
multiple levels. Considering the complexity and the wide 
range of the power transmission and distribution price 
reform policy system and imitating the improved variable 
weight matter element extension model in the literature 
[18], this paper firstly uses the optimal and worst method 
to determine the weight of each index Then, the 
improved matter element extension evaluation method is 


used to establish a comprehensive evaluation model for 
the implementation effect of the power transmission and 
distribution price refomi 

2.1 The Best-Worst method 

The Best-Worst method (BWM) fully considers the 
experts' opinions, experience and knowledge, which is 
based on the idea of pairwise. By sorting out the best and 
worst two special indexes, it simplifies the comparison 
process, reduces the risk of inconsistency, guarantees the 
accuracy of judgment, gets more reliable results, and 
considers the fuzzy problem decision in the absence of 
complete information and qualitative judgment. The 
specific steps are as follows: 


Q 

Step 1: Select the optimal index B and the worst index 

Cw in the indexset ^ c i ,c 2 ^ ,C n} . The selection of the 
optimal index and the worst index do not consider the 
value of the index, but the importance among the indexes. 
The most significant and preferred one is the optimal 
index, and the relatively insignificant and less preferred 
one is the worst index 

Step 2: Use the 1-9 scale to score and determine the 
preference of the optimal index compared to all other 
indexes, and build a comparison vector 

( a B\-> a B 2 ’L i a Bn) Among them, represents 
the degree of preference of the optimal index compared 
with the index i. The larger the value, the more significant 

is the optimal index than the index i. There is 

Step 3: Use 1 to 9 scales to determine the preference of all 

other indexes compared to the worst indexes, and build a 

comparison vector ^ ( a iw’ a 2 W’L ’ a nw ) Among 


them, a,w represents the degree of preference of index i 
compared to the worst index, and the greater the value, 
the more important is the index i better than the worst 


index There is 

Step 4: Construct the mathematical progrannning 
problems and solve them to get the optimal weight 


Cw* w* L w *) 

1 ’ 2 ’ ” .To get the optimal weight for each 

index, it needs to minimize the largest value among all 


{| W /i ~ a Bi W i | ’ | - a i\v W W 11 


indexes’ value 
planning function can be written as: 


, so the 
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min max{|w B - a m w i |, | w t - a iW w w |} 

s.t. 

=1 » 

i 

w t >0,f or i (1) 

The planning function in Equation (1) can be converted 
into the following form to solve: 

min^ 

s.t. 

\ W B ~ a Bi W i\~ ^’f 0r Z 

\ w i ~ a iw w w \ - or i 

Z w «- =1 > 

i 

w. >0,f or i (2) 

Equation (2) is a linear equation and has only one unique 
solution. By solving the model, the optimal weight can be 

, • , , O* w* L ,w ) 

obtained, namely 1 " . 

Step 5: Conduct a consistency check. The consistency 

, 

ratio can be calculated from the values 9 obtained from 
the planning model and consistency coefficients, which is 
as follows: 

£ 

CR = — 

CI ( 3 ) 

where, CR represents the consistency ratio, CI 
represents the consistency coefficient. It can be seen that, 

£ 

the smaller the value of ’ is, the smaller is the 
consistency ratio, and the larger is the consistency 
coefficient, the higher is the reliability of the comparison. 

2.2 Improved matter element extension evaluation 
method 

The matter element extension evaluation method can be 
used to establish a quality assessment model that indicates 
the multifeature performance parameters of an object, and 
the evaluation results can be expressed in quantitative 
specific value. 

Object P has the feature C ; the value or range of C j s 

v u , R = (P,C,V) A t 

r , the ordered triples v ’ composed of 

P , C and ^ serve the basic element, short for matter 
element, which depicts the object. Object P , feature C 
and value ^ are the three factors of element R . 
Provided that P has amount of n features, P can be 

Cj ,C 2 , L , C n 


V j ’ V 2’ L ’V n 
as follows: 


, that depicts R the N dimensions element 


R =(P,C,V): 








P q 

n 

r 2 


c 2 

v 2 

L 


L 

L 

A. 


c n 

v n_ 


(4) 

where \P’Ci>^i ) i—1, 2,L ,n j s Partition 

n C — T C,, C 9 ,L , C 1 

element of ^ . L WJ is n feature vector, 

^ ’ ’ V " ] is the value of feature vector. 

The basic steps of the matter element extension 
evaluation method are: 

Step 1: Determining the classic domain, the joint domain, 
and the matter element to be evaluated. 




P c 

i c i 

v n 


C 2 

V J2 


L 

L 


C n 

V 



P j C 1 < a fl’ b jl'- 

c 2 < aj 2 . bj 2 : 


c <a. ,b. 

n jn ’ jn 


(5) 

p. c c L c 

where 3 is the number j evaluation level, p 2 ’ ’ n 

is the different feature of 7 , 71 ’ 72 ’ ’ 7 " is 7 ’s 

c c L c 

range of value corresponding to *’ 2 ’ ’ which is 

a .. b .. P. 

classic domain, 7 'and is the value boundary of 7 . 

R'-iP.W,)- 

( 6 ) 

where P is the whole level of the object to be evaluated, 

P i’ pi’ ’ pn i s P > s ran g e 0 fvalue corresponding to 

C 1’ C 2’L ,C n 


P c, v pl 


P C l < a pV b pl> 

Vpl 


c 2 < a p 2 .b p2 > 

L L 


L L 

C V 


c <a ,b > 

n pn 


n pn ’ pn 


1 , that is joint domain. 

R 0 ={ p o’C i ,v i ) 


p 0 c i v i 


L L 


(7) 


R n 


where 0 is the matter element to be evaluated, 

V t ’ V 2 ’ L ’ V n ^ P Q > c 

C[,c 2 ,L ,c n 


’s measured data corresponding to 


Step 2: Normalization 

hi the basis of the initial matter element extension 
method, normalize the magnitude of each classic domain 
and the matter element to be evaluated, that is, getting the 
normalized matter element’s classic domain and matter 


described by the features 


and values 
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element to be evaluated by divided the value of the right 
boundary of the domain. 


*1 


Cl 

c 2 

L 


v n 

L 


P, c. 

^ u n u j\ 

J * 

<b Pi’ b Pi 

c 

< a J1 i ± 

c 2 

b p2 b pl 

L 

L 


a. b ■ 


bpn b pn 


( 8 ) 


R, 


(h.c,h> 


P r — 

1 n 


“p i 

b , 

P 2 

L 

v„ 


L 

c„ 


(9) 

Step 3: Determine the weight 

This paper determines the index weight by using BWM 
according to the evaluation object and index 
characteristics. The specific process refers to section 2.1. 
Step 4: Calculate the comprehensive closeness 
The value of the correlation function of each index of the 
matter element to be evaluated and the level of each grade 
is calculated according to the following formula: 

—i— p —iH- eV s 


w= 


P(v„V..) 


P(h>K f )-p(v ; ,VJ 


,v, tVpndply^V ■)*0 


-p(\\ , V~) -1, v. <t V. .andp(v i , V pi ) = 0 

l Jl 


( 10 ) 


K M) , 


where 1 ' indicates the value of the correlation 

function of the number i index with respect to the number 

IvJ 

j level. I 'indicates the distance of the number i index 
with respect to the number j grade classical domain. 

p(v.,V.) 

' ] ‘ indicates the distance between the matter 

element to be evaluated of the number i index and its 

p(v,V .) 

classical domain. ' pl indicates the distance 
between the matter element to be evaluated and its section 
of the first index 

If the actual value of any index exceeds the range of the 
section, it is impossible to calculate the correlation 
function between the indexes of each matter element and 
the level of each grade according to the above formula. 
For the limitation of matter element extension, it needs to 
be improved. 

The distance of the matter element to be evaluated about 
the normalized range of the classical domain is: 


D(V): 


v - 


a Ji +b J. 


b —a 

j ' ji 


( 11 ) 

where v is a point value, a and b are values 
corresponding to the left end point and the right end point 
of the normalized classical domain interval, respectively. 
According to Ref. [10], two asymmetric closenesses are 
constructed, which solve the evaluation problem under 
the failure of the maximum membership criterion. The 
asymmetric closeness formula proposed in this paper 

(P —^). Improvements are available: 

Z Dw < 

N = l-— - 


n ( 12 ) 

where N represents closeness, D represents distance. 


W, 


and ' represents weight. 


R 


The matter-element to be evaluated * 0 and the closeness 
corresponding to each level is 


Z^(v>,.(X) 

Z(p 0 ) = l—- 

n (13) 

NAp 0 ) 

where 1 represents the matter-element to be 

U 

evaluated 0 corresponding to the closeness of level j. 


R, 


represents the matter-element to be evaluated 

0 corresponding to the distance from the normalized 

classic domain, W ‘ represents the weight of the 
indicator; n represents the number of indicators. 

Step 5: Rating 

NAp 0 )=rmx{NXp 0 )\,(j = 1,2,3,L ,m) 

If ; 1 ; ’ , then the 

matter-element to be evaluated belongs to the jth grade. 
Let 

Nj(Po) - min Nj(p 0 ) 


Nj( Po )= 


max Nj (p 0 ) - min Nj (p 0 ) ( |4) 

m _ 


j = 


H 


£jv,(po) 

j =i 


(15) 


where ^ represents the grade value of a variable 
characteristic of matter-element to be evaluated °. The 
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value of J can be judge the degree of bias of 0 toward 
adjacent levels. 

IV. CONCLUSION 

With the deepening of China's transmission and 
distribution tariff reform, the effectiveness and problems 
of the transmission and distribution tariff reform have 
gradually emerged. The evaluation of the implementation 
effect of the transmission and distribution tariff reform 
has important practical significance. Based on the 
improved matter-element extension model and the Best- 
Worst Method, this paper constmcts an evaluation model 
for the implementation effect of transmission and 
distribution tariff reform, and obtains the following 
research results and conclusions: 

(1) Based on the objectives and principles of transmission 
and distribution tariff reform, index system is established 
to evaluate the implementation effect of the reform 
applies to electricity transmission and distribution, 
including economic efficiency, safety and reliability, 
energy saving and satisfaction four dimensions, and 
screen out 12 Evaluation indicators. 

(2) The Best-Worst Method is used to determine the 
weight value for each evaluation index, which simplifies 
the comparison process. The reliability level can be 
measured by the calculation of the consistency ratio, and 
the weight coefficient of each evaluation index is 
accurately obtained. 

(3) Using the improved matter-element extension model 
to establish an evaluation model for the implementation 
effect of transmission and distribution tariff reforms, the 
complex transmission and distribution tariff reform effect 
uncertainty problem can be transformed into an image 
model, through the classic domain and the matter-element 
to be evaluated. The normalization process uses the size 
of the comprehensive closeness to measure the coupling 
relationship between the object to be evaluated and the 
evaluation level, and overcomes the limitations and 
inadequacies of the traditional matter element extension 
model that cannot calculate the correlation coefficient in 
the index exceeding the section. 

In the next research, we will select typical provinces and 
cities in China to evaluate the implementation effect of 
transmission and distribution tariff reform for empirical 
analysis. 
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